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1.  TITLE 

INTERLABORATORY  STUDY  (ILS)  FOR  F  548-01,  THE  STANDARD  TEST  METHOD 
FOR  INTENSITY  OF  SCRATCHES  ON  AEROSPACE  TRANSPARENT  PLASTICS 

Committee  F-7  on  Aerospace  and  Aircraft  Enclosures 
Subcommittee  F-7.08  on  Transparent  Enclosures  and  Materials 
RR:  F07-1007 

2.  INTRODUCTION 

The  American  Society  for  Testing  and  Materials  (ASTM)  develops  and  publishes  standardized 
test  methods.  Each  test  method  requires  a  precision  and  bias  statement  so  organizations  that 
apply  the  method  know  its  inherent  reproducibility  (between-laboratory  variability)  and 
repeatability  (within-laboratory  variability).  Reproducibility  and  repeatability  for  this  test 
method  were  determined  by  conducting  an  interlaboratory  study  (ILS)  as  outlined  in  ASTM  E 
691.  This  report,  which  conforms  to  the  ILS  reporting  format  required  by  ASTM,  describes  the 
study  that  was  conducted  for  ASTM  test  standard  F  548-01,  Intensity  of  Scratches  on  Aerospace 
Transparent  Plastics. 

Scratches  exist  on  virtually  all  transparent  plastic  surfaces.  Usually,  cleaning  procedures  cause 
very  fine  scratches  that  are  not  visible  when  looking  through  the  plastic.  Visible  scratches  may 
be  distracting  to  an  observer  looking  through  an  aerospace  transparent  plastic.  Therefore,  a 
procedure  to  define  scratches  is  useful.  A  visual  comparison  is  made  between  a  set  of  graded 
scratch  standards  (adjuncts)  and  a  scratch  on  the  plastic  transparency  to  determine  its  relative 
intensity.  A  visual  standard  is  used  because  it  is  not  practical  to  measure  the  dimensions  of  the 
fine  scratches. 

3.  TEST  METHOD 

See  ASTM  F  548-01,  Standard  Test  Method  for  Intensity  of  Scratches  on  Aerospace  Transparent 
Plastics 

4.  LIST  OF  PARTICIPATING  LABORATORIES 

AFRL/HECV 

2255  H  St.  Room  300 

Wright-Patterson  AFB,  OH  45433-7022 

University  of  Dayton  Research  Institute 
300  College  Park  Ave. 

Dayton,  OH  45469-0110 

PPG  Industries,  Inc. 

1719  E.  Highway  72 
Huntsville,  AL  35811 
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5.  INTERLABORATORY  TEST  PROGRAM  INSTRUCTIONS 

Cover  letter  for  test  instructions  to  participating  laboratories: 

Subject:  ASTM  Interlaboratory  Study  (ILS)  for  Measuring  Intensity  of  Scratches  on  Aerospace 
Transparent  Plastics 

To:  Participating  Organization 
From:  Alan  Pinkus 
AFRL/HECV,  2255  H  St.  Room,  300 
Wright-Patterson  AFB  OH  45433-7022 
Dear  Colleague, 

As  part  of  ASTM  Committee  7.08  standards  writing  activity,  we  are  conducting  an  ILS  in  order 
to  ascertain  the  precision  of  Standard  Test  Method  for  Intensity  of  Scratches  on  Aerospace 
Transparent  Plastics,  F  548-01.  Since  this  method  has  a  numerical  result,  it  requires  a  precision 
statement.  After  the  ILS,  F  548-01  will  be  revised  to  include  a  precision  statement. 

You  recently  took  part  in  an  ILS  forjudging  the  intensity  of  scratches  in  glass.  This  study  has 
essentially  the  same  format  except  it  is  forjudging  the  intensity  of  scratches  in  plastic.  Your 
participation  in  this  study  is  greatly  appreciated.  No  data  will  be  released  with  any  company  or 
individual  identification  labels.  The  data  in  the  ILS  report  to  ASTM  are  given  generic  labels  and 
the  final  precision  statement  uses  only  summary  statistics  as  outlined  in  ASTM  E691  and  ASTM 
E  177.  If  there  are  any  questions,  please  do  not  hesitate  to  contact  Alan  Pinkus  (937-255-8767) 
or  Martha  Hausmann  (937-255-1205). 


Sincerely, 

Alan  Pinkus,  Ph.D. 


6  Attachments: 

1.  ASTM  F  548-01  Standard  Test  Method 

2.  Aerospace  Scratch  Adjuncts  for  Plastic 

3.  16  Plastic  Scratch  Samples 

4.  Test  Instructions 

5.  Datasheet 

6.  Return  Address  Label 

Test  Instructions: 

Your  task  is  to  determine  the  scratch  intensity  levels  of  different  scratch  samples. 

1.  Complete  the  background  information  on  the  data  sheet. 

2.  There  are  16  plastic  scratch  samples  and  8  scratch  test  standards.  The  16  plastic  scratch 
samples  to  be  compared  to  the  scratch  test  standard  and  rated  are  labeled  A  through  P.  The  8 
scratch  test  standards  are  labeled  11  through  18.  Caution:  this  ASTM  standard  costs  $1500. 

3.  Please  refer  to  the  attached  standard  F  548-01  for  the  test  methodology.  Beginning  with 
trial  #1  on  the  data  sheet,  select  the  designated  scratch  sample  (A  through  P)  and  place  in  an 
angled  position  to  allow  for  optimum  visual  definition  of  the  scratch.  Please  handle  the 
scratch  samples  and  standard  by  the  edges  only  to  avoid  getting  fingerprints  on  them.  If  they 
become  dirty,  carefully  wipe  using  the  supplied  cloth.  The  light  level  required  for  judgment  is 
a  minimum  of  80  lux.  Natural  or  artificial  light  may  be  used.  Determine  the  rating  of  the 
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scratch  sample  by  comparing  it  to  the  scratch  test  standard  by  placing  the  test  standard  next  to 
the  scratch  sample,  one  at  a  time.  Select  the  test  standard  rating  (1 1  through  18)  that  most 
closely  matches  the  scratch  sample.  Disregard  scratch  lengths.  Record  the  scratch  level 
number  in  the  rating  column  located  on  the  data  sheet.  Repeat  this  procedure  for  all  80  trials. 
4.  Return  your  data  sheet,  the  plastic  scratch  samples  and  the  scratch  adjunct  to  Alan  Pinkus, 
AERL/HECV,  2255  H  St,  Room  300,  Wright-Patterson  AFB  OH  45433-7022  (937-255- 
8767).  Note:  The  packaging  has  been  designed  for  reuse  for  both  your  convenience  and  to 
assure  full  protection  of  the  delicate  test  pieces.  A  return  address  label  has  been  included. 
Please  insure  the  contents  for  $1500.  Please  complete  your  portion  of  the  ILS  as  quickly  as 
possible  because  many  companies  are  participating  in  this  large  study. 


Sample  Data  Sheet: 
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6.  DATA  REPORT  FORMS 

See  Appendix  A 

7.  STATISTICAL  DATA  SUMMARY 

Fifteen  trained  observers  rated  16  plastic  scratches.  Each  scratch  was  rated  five  times  by  each 
observer.  The  80  trials  for  each  observer  were  randomized  with  the  constraint  that  there  be  at 
least  10  trials  between  replications  of  the  same  scratch.  Observers  were  provided  adjuncts  that 
had  scratch  ratings  of  11,  12, ...,  18  (11  the  thinnest,  18  the  thickest).  For  an  individual  trial,  the 
observer  would  place  1  of  the  16  scratches  next  to  the  adjuncts  and  determine  the  closest  match. 
Figures  2a  and  2b  show  the  number  of  trials  for  each  observer  and  scratch  having  a  particular 
scratch  rating. 

Table  1  shows  the  judged  rank-order  of  the  plastic  scratch  samples.  Figure  1  contains  the 
percent  of  the  75  total  trials  (15  observers  times  five  replications)  for  each  scratch  having  a 
particular  scratch  rating. 


Table  1.  Rank-order  of  plastic  scratch  samples. 
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Legend  is  percent  of  trials  (N  =  75) 


Figure  1 .  Percent  of  all  trials  for  each  scratch 
(N  =  75)  having  a  particular  scratch  rating. 


Of  interest  is  how  consistently  the  observers  rated  each  scratch  for  their  five  replications  and 
how  close  scratch  ratings  were  from  one  observer  to  another.  For  continuous  variables, 
repeatability  and  reproducibility  limits  could  be  determined  using  the  normal  distribution  where 
95th  percentiles  for  absolute  difference  in  trials  are  estimated.  The  discrete  ratings  in  this  data 
does  not  lend  itself  to  this  type  of  analysis.  Instead,  the  percent  of  all  absolute  differences  in 
trials,  both  within  and  between  observers,  was  calculated  for  each  possible  absolute  difference 
(i.e.,  0  to  7).  Results  are  shown  in  Table  2.  Cumulative  percents  are  shown  in  Table  3. 


Table  2.  Mean  rating  across  all  observers  and  trials  (N  =  75)  and  percent  of  absolute  difference  in 
trials  both  within  (N  =  15  observers  *  10  paired  reps  per  observer  =  150)  and  between  (N  =  15 
observers  *  (5  reps  *  70  other  trials)/2  =  2625)  observers. 
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Table  3.  Mean  rating  across  all  observers  and  trials  (N  =  75)  and  cumulative  percent  of 
absolute  difference  in  trials  both  within  (N  =  15  observers  *  10  paired  reps  per  observer 
=  150)  and  between  (N  =  15  observers  *  (5  reps  *  70  other  trials)/2  =  2625)  observers. 
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Figure  2a.  Number  of  trials  for  observers  1-9  and  scratch  (N  =  5)  having  a  particular  scratch  rating. 
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Legend  is  number  of  trials  Scratch 

•  Mean  across  observers  and  trials 


Figure  2b.  Number  of  trials  for  observers  10-15  and  scratch  (N  =  5)  having  a  particular  scratch  rating. 


8.  RESEARCH  REPORT  SUMMARY 

Standard  repeatability  and  reproducibility  analyses  (ASTM  E  691)  cannot  be  applied  to  these 
data  since  they  are  discrete  instead  of  continuous.  The  cumulative  percent  of  the  absolute 
difference  in  trials  data  shown  in  Table  3  best  delineate  the  within-laboratory  (observer)  and 
between-laboratory  variability  that  may  be  expected  for  this  test  method. 

9.  PRECISION  and  BIAS 

Precision  -  The  repeatability  of  judging  the  intensity  of  a  scratch  within  one  scratch  value,  for 
the  same  observer,  is  92%  or  better. 

The  reproducibility  (between  observers)  of  judging  the  intensity  of  a  scratch  within  one  scratch 
value  is  90%  or  better  for  scratch  values  14  and  above.  The  reproducibility  of  judging  the 
intensity  of  a  scratch  within  two  scratch  values  is  92%  or  better  for  scratch  values  below  14.  The 
data  reflect  that  it  is  more  difficult  to  judge  finer  scratches. 

Bias  -  The  procedure  in  this  test  method  has  no  bias  because  the  scratch  intensity  is  defined  only 
in  terms  of  the  test  method. 
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Data  report  forms: 
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APPENDIX  A  (continued) 
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APPENDIX  A  (continued) 
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APPENDIX  A  (continued) 


12 


APPENDIX  A  (continued) 
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APPENDIX  A  (continued) 
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APPENDIX  A  (continued) 
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APPENDIX  A  (continued) 


ASTM  Intensity  of  Scratches  in  Plastic  Interlaboratory  Study  Data  Sheet 
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APPENDIX  A  (continued) 
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APPENDIX  A  (continued) 
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APPENDIX  A  (continued) 
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APPENDIX  A  (continued) 


20 


APPENDIX  A  (continued) 
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APPENDIX  A  (continued) 
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APPENDIX  B  (Non-mandatory  Information) 

Comparison  of  Glass  and  Plastic  Scratch  Ratings 

A  study  was  performed  to  determine  equivalent  relationships  between  glass  and  plastic  scratch 
adjuncts.  This  empirically  derived  relationship  can  be  used  if  needed  when:  (1)  only  glass  adjuncts  are 
available  to  judge  the  intensity  of  scratches  in  plastic,  (2)  only  plastic  adjuncts  are  available  to  judge  the 
intensity  of  scratches  in  glass  or  (3)  it  is  desirable  to  convert  the  between  the  glass  and  plastic  scales. 

Five  trained  observers  rated  eight  glass  and  eight  plastic  scratches.  Each  scratch  was  rated 
using  both  glass  and  plastic  adjuncts  three  times.  The  96  trials  for  each  observer  were  randomized  with 
the  constraint  that  there  be  at  least  five  trials  between  replications  of  the  same  scratch  and  either  glass  or 
plastic  adjunct.  Figure  3  shows  the  number  of  trials  for  each  observer  and  scratch  having  a  particular 
scratch  rating. 

Figure  1  contains  the  estimated  relationship  between  the  glass  (G)  and  plastic  (P)  scratch  ratings 
and  between  the  plastic  and  glass  ratings.  Table  1  and  Figure  2  contain  the  mean  scratch  rating  for  each 
scratch. 


J 


Figure  1.  Non-linear  regression  fit  of  mean  scratch  ratings  (N  =  15).  The  3  means 
near  (P  =  11,  G  =  3)  and  the  2  means  near  (P  =  15,  G  =  8)  were  not  used  since  they 
contained  multiple  trials  where  the  glass  rating  was  either  3-  or  8+, 
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s  Scratch  Rating 


Table  1.  Mean  glass  and  plastic  scratch  rating  for  each  scratch 
(N  =  15).  Ratings  are  sorted  by  glass  adjunct. 


Plastic  Scratch  Rating 


Plastic  Scratch  Rating 


Figure  2.  Mean  glass  and  plastic  scratch  rating  for  each  scratch  (N  =  15). 
Solid  line  segments  connect  means  in  this  study  with  means  from  previous 
studies  involving  glass  or  plastic  only. 
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